EEEA-Net: An Early Exit Evolutionary Neural Architecture Search
نویسندگان
چکیده
The goals of this research were to search for Convolutional Neural Network (CNN) architectures, suitable an on-device processor with limited computing resources, performing at substantially lower Architecture Search (NAS) costs. A new algorithm entitled Early Exit Population Initialisation (EE-PI) Evolutionary Algorithm (EA) was developed achieve both goals. EE-PI reduces the total number parameters in process by filtering models fewer than maximum threshold. It will look a model replace those more Thereby, reducing parameters, memory usage storage and processing time while maintaining same performance or accuracy. reduced 0.52 GPU day. This is huge significant achievement compared NAS 4 days achieved using NSGA-Net, 3,150 AmoebaNet model, 2,000 NASNet model. As well, networks (EEEA-Nets) yield network architectures minimal error computational cost given dataset as class algorithms. Using EEEA-Net on CIFAR-10, CIFAR-100, ImageNet datasets, our experiments showed that lowest rate among state-of-the-art models, 2.46% 15.02% 23.8% dataset. Further, we implemented image recognition architecture other tasks, such object detection, semantic segmentation, keypoint detection and, experiments, EEEA-Net-C2 outperformed MobileNet-V3 all these various tasks. (The code available https://github.com/chakkritte/EEEA-Net).
منابع مشابه
A Time-derivative Neural Net Architecture - an Alternative to the Time-delay Neural Net Architecture
Though the time-delay neural net architecture has been recently used in a number of speech recognition applications, it has the problem that it can not use longer temporal contexts because this increases the number of connection weights in the network. This is a serious bottleneck because the use of larger temporal contexts can improve the recognition performance. In this paper, a time-derivari...
متن کاملProgressive Neural Architecture Search
We propose a method for learning CNN structures that is more efficient than previous approaches: instead of using reinforcement learning (RL) or genetic algorithms (GA), we use a sequential model-based optimization (SMBO) strategy, in which we search for architectures in order of increasing complexity, while simultaneously learning a surrogate function to guide the search, similar to A* search....
متن کاملDifferentiable Neural Network Architecture Search
The successes of deep learning in recent years has been fueled by the development of innovative new neural network architectures. However, the design of a neural network architecture remains a difficult problem, requiring significant human expertise as well as computational resources. In this paper, we propose a method for transforming a discrete neural network architecture space into a continu...
متن کاملEvolutionary Architecture Search For Deep Multitask Networks
Multitask learning, i.e. learning several tasks at once with the same neural network, can improve performance in each of the tasks. Designing deep neural network architectures for multitask learning is a challenge: There are many ways to tie the tasks together, and the design choices matter. The size and complexity of this problem exceeds human design ability, making it a compelling domain for ...
متن کاملEarly exit: Estimating and explaining early exit from drug treatment
BACKGROUND Early exit (drop-out) from drug treatment can mean that drug users do not derive the full benefits that treatment potentially offers. Additionally, it may mean that scarce treatment resources are used inefficiently. Understanding the factors that lead to early exit from treatment should enable services to operate more effectively and better reduce drug related harm. To date, few stud...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Engineering Applications of Artificial Intelligence
سال: 2021
ISSN: ['1873-6769', '0952-1976']
DOI: https://doi.org/10.1016/j.engappai.2021.104397